Common Tasks : How to set up a search set to crawl feeds

How to set up a search set to crawl feeds

DEVONagent Pro not only queries search engines for you, it can also search on its own by "crawling" a specified list of webpages or news feeds and scanning them for the search term. This feature is handy when you have a number resources you want to watch, e.g., subject-specific news sites or feeds.

Crawling feeds

Step by step: You want to search one of the New York Times news feeds.

Step 1: Click here to open the Search Sets window. Open it manually using Window > Search Sets.
Step 2: Click the + button to create a new set. Name it, e.g., "New York Times".
Step 3: Switch to the Sites tab.
Step 4: Click here to open the New York Times RSS page in a new web browser window.
Step 5: Show the Inspectors tab using Web > Inspectors > Show and switch to the tab.
Step 6: Copy the address of any RSS feed of interest by right-clicking it and choosing Copy from the context menu.
Step 7: Switch to the Search Sets window and paste it, e.g., by pressing ⌘V. or using Edit > Paste.

Repeat Steps 6 and 7 for any feeds that you want to add to your "New York Times" search set. You can now use this set like any other search set or plugin. Instead of querying any search engines, it will download the current state of all the feeds you have added and search them for occurences of your search term.

Next steps: